Parrondo's games as a discrete ratchet 
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^v^j , We write the master equation describing the Parrondo's games as a consistent discretization 

of the Fokker-Planck equation for an overdamped Brownian particle describing a ratchet. Our 
expressions, besides giving further insight on the relation between ratchets and Parrondo's games, 
allow us to precisely relate the games probabilities and the ratchet potential such that periodic 
potentials correspond to fair games and winning games produce a tilted potential. 
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' The Parrondo's paradoxal 0] shows that the alternation of two losing games can lead to a winning game. This 
, surprising result is nothing but the translation into the framework of very simple gambling games of the ratchet 

S effect 0. In particular, the Bashing ratchetQ]^ can sustain a particle flux by alternating two relaxational potential 
dynamics, none of which produces any net flux. Despite that this qualitative relation between the Parrondo paradox 
and the flashing ratchet has been recognized from the very beginning (and, in fact, it constituted the source of 
inspiration for derivingthe paradoxical games), only very recently there has been some interest in deriving exact 
^ i relations between bothjg, 0] . 

In this paper, we rewrite the master equation describing the evolution of the probabilities of the different outcomes 
of the games in a way that shows clearly its relation with the Fokker-Planck equation for the flashing ratchet. In this 
way, we are able to give an expression for the dynamical potentials in terms of the probabilities defining the games, 
| as well as an expression for the current. Similarly, given a ratchet potential we are able to construct the games that 

■ correspond to that potential. 

The Parrondo's paradox considers a player that tosses different coins such that a unit of "ca pita l" is won (lost) 
, if heads (tails) show up. Although several possibilities have been proposed[8l ITol ITU Il2l fl3l Il4| , in this paper 

we consider the original and easiest version in which the probability of winning, pi, depends on the actual value of 
the capital, i, modulus a given number L. A game is then completely specified by giving the set or probabilities 
{po,Pi, . . . ,pl-i} from which any other value pk can be derived as pk = PkmodL- A fair game, one in which gains 
and losses average out, is obtained if Uto^ = n^o 1 (^ ~ Pi)- The paradox shows that the alternation (either 
' random or periodic) of two fair games can yield a winning game. For instance, the alternation of game A defined by 
, pi = p = 1/2, Vi, and game B defined by L = 3 and po = 1/10 ,p\ = pi = 3/4 produces a winning game although 

■ both A and B are fair games. 

A discrete time r can be introduced by considering that every coin toss increases r by one. If we denote by Pi(r) 
the probability that at time r the capital is equal to i, we can write the general master equation 

P(t + 1) = a^/V^r) + a*P 4 (r) + a\P +1 ( T ) (1) 

where a x _ x is the probability of winning when the capital is i — 1, a\ is the probability of losing when the capital 
is i + 1, and, for completeness, we have introduced a l as the probability that the capital i remains unchanged (a 
possibility not considered in the original Parrondo games). Note that, in accordance with the rules described before, 
we have taken that the probabilities {a l _ 1 , a l , a\} do not depend on time. It is clear that they satisfy: 

a-i 1 +«o + «r 1 = 1 (2) 

•i-H , 

^ . which ensures the conservation of probability: J2i P( T + 1) = Yli Pii T )- 

It is a matter of straightforward algebra to write the master equation in the form of a continuity equation: 

P z (t + 1) - Pi( T ) = - [J i+1 (t) - Ji(t)] (3) 

where the current Ji(r) is given by: 

Mr) = \ [FiPi{T) +F i _iP«_i(T)] - [AP(r) - A-iP-i(r)] (4) 



and 



Fi =a i + 1 -a\- 1 , A^KlY+ar 1 ) (5) 
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This form is a consistent discretization of the Fokker-Plank equation[15| for a probability P(x, t) 

dP(x,t) _ dJ(x,t) 



with a current 



at 



J{x,t) = F(x)P(x,t) - 



dx 



d[D(x)P{x,t)} 
dx 



(6) 



(7) 



with general drift, P(x), and diffusion, D(x). If At and Ax are, respectively, the time and space discretization steps, 
such that x = iAx and t = rAi, it is clear the identification 



At 
A. 



-P(iAx), 



Di 



At 

(Ax) 2 



D(iAx) 



(8) 



The discrete and continuum probabilities are related by Pi(r) <-> P(iAx, rAt) Ax and the continuum limit can 

(Ax) 2 

be taken by considering; that M = lim — : is a finite number. In this case Fi <-> M _1 AxF(iAx) and 

J 6 Ai^O.Aa^O At i \ ! 

Di <-> M~ 1 D(iAx). 

From now on, we consider the case a l = 0. Since p$ = a!^ 1 we have 



D, 



D = 1/2 



Fi 



1 + 2p t 



(9) 



and the current Jj(r) = —(1 — pi)Pi(r) + pi_iP_i(r) is nothing but the probability flux from i — 1 to i. 

The stationary solutions P/* can be found solving the recurrence relation derived from Q for a constant current 
Ji = J with the boundary condition P/* = Pfl L : 



Pf* = iVe-^/ D 



2J 

iV 



^ I - Fj 

j=i J 



(10) 



with a current 



J = N 



c- v ^ D - 1 



(11) 



N is the normalization constant obtained from ^2f = Q Pf* = 1. In these expressions we have introduced the potential 
Vi in terms of the probabilities of the games [l6| 



3 = 1 



l + F 



3-1 



1 - P, 



= -P£ln 

3 = 1 

V -- 



P3-1 



(12) 



1 - Pj . 

The case of zero current J = 0, implies a periodic potential Vl = Vo = 0. This reproduces again the condition 
Ili^o 1 ^ = Il^=o 1 (l — -Pi) l° r a l a i r game- In this case, the stationary solution can be written as the exponential 
of the potential Pf = Ne~ v > /D . Note that Eq.JEJ reduces in the limit Ax -> to 7(x) = -M" 1 / P(x)dx 
or P(x) = —M dV d ^ , which is the usual relation between the drift P(x) and the potential V(x) with a mobility 
coefficient M. 

The inverse problem of obtaining the game probabilities in terms of the potential requires solving Eq. I|12fl with 
the boundary condition Fq = Fl 



F = (-iye v >/ D 



i:f =1 (-me- v > /D -c- v '- i/D } 

(-\)L e (V -V L )/D _ l 



3 = 1 



e v j/D _ e -v j . 1 /D ] 



(13) 



These results allow us to obtain the stochastic potential Vi (and hence the current J) for a given set of probabilities 
{po, ■ ■ ■ ,Pl-i}, using (|12fl : as well as the inverse: obtain the probabilities of the games given a stochastic potential, 
using (|13fl . Note that the game resulting from the alternation, with probability 7, of a game A with pi = 1/2, Vi and 




FIG. 1: Left panel: potential Vi obtained from 111 2t for the fair game B denned by po = 1/10, pi = p% = 3/4. Right panel: 
potential for game B' , with p' — 3/10, p[ — p' 2 = 5/8 resulting from the random alternation of game B with a game A with 
constant probabilities pi = p — 1/2, Vi. 



a game B defined by the set {po, . . . ,pl-i} has a set of probabilities {p' , . . . ,i>£_i} with p[ L = (1 — 7)5 + 7f>j. For the 
FSs variables, this relation yields: 

H = jFi, (14) 

and the related potential V follows from l|12|). 

We give now two examples of the application of the above formalism. In the first one we compute the stochastic 
potentials of the fair game B and the winning game B' , the random combination with probability 7 = 1/2 of game B 
and a game A with constant probabilities, in the original version of the paradoxal . The resulting potentials are shown 
in figure Notice how the potential of the combined game clearly displays the asymmetry under space translation 
that gives rise to the winning game. 
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FIG. 2: Left panel: Ratchet potential 1151 in the case L = 9, A = 1.3. The dots are the discrete values Vi = V(i) used in 
the definition of game B. Right panel: discrete values for the potential V( for the combined game B' obtained by alternating 
with probability 7 = 1/2 games A and B. The line is a fit to the empirical form V'(x) = — Fx + aV(x) with F — 0.009525, 
a = 0.4718. 



The second application considers as input the potential 

'2ttx\ 1 



V(x) = A 



( A-kx 

— sin 

4 \ L 



(15) 



which has been widely used as a prototype for ratchets ,3]. Using (jT3|) we obtain a set of probabilities {po, ■ ■ ■ ,Pl~i} 
by discretizing this potential with Ax = 1, i.e. setting Vi — V(i). Since the potential V(x) is periodic, the resulting 
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game B defined by these probabilities is a fair one and the current J is zero. Game A, as always is defined by 
Pi = p = 1/2, Vi. We plot in figure |21 the potentials for game B and for the game B' , the random combination with 
probability 7 = 1/2 of games A and B. Note again that the potential V( is tilted as corresponding to a winning game 
B' . As shown in figure[3| the current J depends on the probability 7 for the alternation of games A and B. 
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FIG. 3: Current J resulting from equation li lt for the game B' as a function of the probability 7 of alternation of games A 
and B. Game B is defined as the discretization of the ratchet potential 1151 in the case A — 0.4, L — 9. The maximum gain 
corresponds to 7 = 0.57. 

In summary, we have written the master equation describing the Parrondo's games as a consistent discretization of 
the Fokker-Planck equation for an overdamped Brownian particle. In this way we can relate the probabilities of the 
games {po, . . . ,pl-i} to the dynamical potential V(x). Our approach yields a periodic potential for a fair game and 
a tilted potential for a winning game. The resulting expressions, in the limit Ax — > could be used to obtain the 
effective potential for a flashing ratchet as well as its current. 
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